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Abstract 

Much learning is done by way of studying precedents and exercises. A teacher supplies a 
story, gives a problem, and expects a student both to solve a problem and to discover a 
principle. The student must find the correspondence between the story and the problem, 
/-\ apply the knowledge in the story to solve the problem, generalize to form a principle, and 

index the principle so that it can be retrieved when appropriate. This sort of learning 
pervades Management, Political Science, Economics, Law, and Medicine as well as the 
development of common-sense knowledge about life in general. 

This paper presents a theory of how it is possible to learn by precedents and exercises 
and describes an implemented system that exploits the theory. The theory holds that causal 
relations identify the regularities that can be exploited from past experience, given a 
satisfactory representation for situations. The representation used stresses actors and 
objects which are taken from English-like input and arranged into a kind of semantic 
network. Principles emerge in the form of production rules which are expressed in the 
same way situations are. 

This paper, with the second appendix removed, will appear shortly in the Artificial 
Intelligence Journal. 

This research was done at the Artificial Intelligence Laboratory of the Massachusetts 
Institute of Technology. Support for the Laboratory's artificial intelligence research is 
provided in part by the Advanced Research Projects Agency of the Department of Defense 
under Office of Naval Research contract N00014-80-C-0505. 
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PRECEDENTS AND EXERCISES 

ITiis paper presents a theory of how it is possible to learn principles from precedents and 
exercises. The theory holds that causal relations identify the regularities that can be 
exploited from past experience in Management, Political Science, Economics, Medicine, 
and Law as well as from everyday life. 

The paper begins with a presentation of some examples that illustrate the sort of 
learning to be explained. Next, there is a review of a representation and some matching 
issues developed in a previous paper which concentrated on establishing two-situation 
correspondences [21]. And finally there is a description of the principle forming and 
indexing ideas that enable principles to be created and stored. There are references 
throughout to an implemented system that actually does reasoning, principle forming, and 
indexing using precedents and exercises. 

The implemented system has a number of key ingredients, the following in particular: 

o Analogy-based reasoning. Analogy is based on the assumption that if two situations 
are similar in some respects, then they must be similar in other respects as well. Here 
the causal structure of the precedent situation is assumed to map onto the exercise 
situation. 

o Learned if-then rules. In contrast to current practice in Knowledge Engineering, 
if-then rules emerge as problems are solved. Teachers supply precedents and 
exercises, leaving the work of formulating the if-then rules to the system. 

o Actor-oriented indexing. Context is established by the classes of the actors involved in 
problem situations. This is effected by storing the learned if-then rules according to 
the classes of the actors that are involved. 

o Mixed induction and deduction. Under certain circumstances a relation may be 
assumed if it both explains the presence of some existing relations and allows a new 
relation to be deduced. 

In addition, the implemented system inherits some key ingredients from previous work: 

o Actor-object representation. Situations are represented using relations between pairs 
of situation parts. Supplementary descriptions can be attached to the relations when 
elaboration is needed. 
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o Importance-dominated matching The similarity between two situations is measured 
by finding the best possible match according to what is important in the situations. 
Importance is determined by causal connections in the situations themselves. Causal 
connection is viewed as a common importance-determining constraint 

The system works in domains where the situations satisfy certain criteria: the first is 
that each situation can be described by using a vocabulary of a few hundred properties, 
classes, acts, and other relations; the second is that one situation is similar to another if the 
important relations in their descriptions can be placed in correspondence; the third is that 
the important relations of each situation are the ones explicitly said to be important by 
some teacher or implicitly known to be important by being involved in cause-effect 
relations; and the fourth is that the causes in similar situations generally lead to similar 
effects. The system will not work in domains such as vision and speech where different 
descriptive apparatus is necessary and where different regularities emerge. 

WHAT IS TO BE UNDERSTOOD 

One way to determine if work in Artificial Intelligence has been successful is to use these 
criteria: first, there must be an implemented program capable of performing specified 
tasks; and second, the program must get its power from the knowledge embodied in an 
identified set of regularities or constraints. Thus, for there to be success by these criteria, 
there must be both competence (expressed knowledge) and performance (a demonstration 
that competence has been put to use). 

Let us begin, then, by specifying some tasks to be performed. Consider the following 
precis of Macbeth, given by a teacher as a precedent: 

In MA there is Macbeth Lady-Macbeth Duncan and Macduff. Macbeth is an 
evil noble. Lady-Macbeth is a greedy ambitious woman, Duncan is a king. 
Macduff is a loyal noble. Macbeth is evil because Macbeth is weak and because 
Macbeth married Lady-Macbeth and because Lady-Macbeth is greedy. 
Lady-Macbeth persuades Macbeth to want to be king. Lady-Macbeth 
influenced Macbeth because Lady-Macbeth is greedy and because Macbeth 
married Lady-Macbeth. Macbeth murders Duncan with Lady-Macbeth using a 
knife because Macbeth wants to be king and because Macbeth is evil, 
Lady-Macbeth kills Lady-Macbeth. Macduff is angry. Macduff kills Macbeth 
because Macbeth murdered Duncan and because Macduff is loyal. 

Next, consider the following exercise: 

In EXERClSE-MA-1 there is a man and a woman. The man married the 
woman. The man is weak and the woman is greedy, Show that the man in 
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EXERCISE-MA-1 may be evil. 

Told by a teacher that Macbeth is to be considered a precedent, a student should establish 
the correspondence between the man and Macbeth and between the woman and 
Lady-Macbeth. Next the student should announce that the precedent suggests that the 
man is evil in the sense that he is likely to commit evil acts. Then the student should form a 
principle-capturing if-then rule suggesting that the weakness of a man and the greed of his 
wife can cause the man to be evil. The rule should be accessible whenever it is desired to 
see if there is reason to think that a man is evil. 

Another situation is described and another question is posed in this second example: 

In EXERCISE-MA-2 there is a noble a lady a prince and a king. The noble 
married the lady. The noble is evil and the lady is greedy and the prince is 
loyal. Show that the prince in EXERCISE-MA-2 may kill the noble. 

Responding, the student should establish appropriate correspondences as before. Then the 
student should announce that the prince may kill the noble, given Macbeth is a precedent 
Then the student should create a rule relating the evil of a noble and the greed of his wife 
to the noble's death at the hands of a loyal prince. The rule should be indexed so as to be 
accessible whenever it is desired to show that a prince kills a noble. 
/"-n There is an implemented program that behaves as the student does in these 

representative examples, doing problem solving by analogy, rule formation, and rule 
indexing and retrieving. Thus a specified task is performed by the program, satisfying the 
first criterion for success. The program works because causal connections between 
relations in past situations tend to show up in future situations. Thus the program works 
because it exploits an identifiable regularity, satisfying the second criterion for success. 

So far, the program has learned about two dozen simple rules using toy-like 
precedents and exercises from Macbeth World, Medicine World, and Politics World. 

REPRESENTING AND MATCHING SITUATIONS 

I define a representation to be a vocabulary of symbols together with some conventions for 
arranging them to form descriptions of objects in a domain. Some desirable attributes for a 
representation are that it makes the important facts explicit, it suppresses irrelevant detail, 
it exposes constraint, and it can be reached by an existing translator working from a natural 
input 
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A a 01 -object Representation 

Ihe particular representation used in this work is based on two key assumptions: first, that 
what needs to be represented can be expressed in simple English; and second, that much of 
what can be expressed in simple English can be described using a representation that has 
slots for both a relation and the things that the relation ties together. 

For the simplest sentences, the things involved are just the actor and the object, and 
the relation is an act. For others, the actor and object are supplemented by other things 
that participate in act description, such as an instrument, a time or location, or perhaps a 
source or destination if the act involves motion. In the following, for example, an 
instrument is specified: 

Macbeth murders Duncan with a knife. 

Knowing the kinds of things that are involved in describing an act and understanding how 
to recognize those things in sentences is the objective of case- grammar theories of sentence 
meaning [6]. Actors, objects, instruments, and similar terms are used as names for case 
slots. Sentence analysis is viewed as the job of filling case slots using sentences as r£w 
material. 

In this work, the actors and objects in situations are represented graphically as nodes 
that are tied together with acts and other relations forming a kind of semantic net When 
more than an actor and an object is involved in an act, a supplementary description is tied 
to the act-specifying relation, making the representation capable of bearing case-like 
information. The supplementary description itself consists of a node related to other nodes 
as illustrated by figure 1. 

Information about properties and classes is easily conveyed by using A-KIND-OF 
and HAS-PROPERTY relations. Supplementary description nodes can be attached to 
A-KIND-OF, HAS-PROPERTY, and other relations as well as to acts. 

Note A (all notes are in an appendix) goes into more detail about the implementation 
of the representation. 

English-like Input and Simple Deductions 

If descriptions are produced automatically from a natural input, then there is less danger of 
doing all the real work before the computer actually gets the data. Thus descriptions in the 
actor-object representation should be computable from simple English descriptions or from 
something that is at least close to simple English. Moreover, a translator from English-like 
descriptions to actor-object descriptions makes experimental work practicable. 

In fact, two translators have been designed and implemented: a simple one, easily 
modified by me, for current use and a more powerful one, less easily modified by me, for 
future application. The simple one is based on LIFER, but lacks LIFER's 
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Figure 1: Supplementary description nodes MURDER-T and KILL-2 carry case-like 
information supplementing the actor and object 



pronoun-handling features [10]. The other one is the work of Katz [11]. The Macbeth 
^ example was given in the form that the simple translator handles. Note B illustrates what 

Katz's translator can do. 

The use of natural input also requires a way to make some simple deductions as 
sentences are read, reducing the need for tedious attention to details. For example, given 
that Macbeth marries Lady-Macbeth, Lady-Macbeth clearly marries Macbeth. Similarly 
since Macbeth kills Duncan, it is clear that Duncan is dead. Such obvious deductions are 
done in the implementation by a few demons that are invoked when relations are added 
into the data base. 

Matching Establishes Part Correspondence 

Analogy is based on the assumption that if two situations are similar in some respects, then 
they must be similar in other respects as well. To determine if two situations are similar, 
the parts of the situations must be placed in correspondence. The purpose of matching is to 
establish the best way to do this. 

The performance of the current matcher [2], is described in noteC. Two 
characteristics of the matcher are as follows: 
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o The matcher has a function by which it judges the similarity between two parts. The 
similarity function uses properties, classes, acts, and other relations, depending pn 
what is important. (A previous paper gives more detail on the similarity function 
[21].) 

o The matcher searches the space of all possible matches heuristically, beginning by 
linking up the most similar parts from the two situations and then moving on to those 
that are less similar. The parts that are linked supply helpful evidence for linking up 
those that are not. 

At the moment, there are two ways to determine what is important. One way is to attribute 
importance to all relations; the other is to attribute importance only those relations that are 
the antecedent or consequent of a causal relation, NoteD describes the various words 
implying cause and shows how they are interpreted. 

The reason that relations connected by CAUSE are important is that they are, ipso 
facto, the ones involved in a constraint that may transfer from a precedent to a new 
situation. 

Cause can Bias Matching toward Properties, Classes, or Relations 

Tn her excellent papers on analogy, Centner observes that properties and classes seem to 
influence correspondence more than relations when people are beginners in a problem 
domain [8]. Later on, there is a reversal: relations have more influence than properties and 
classes. 

These observations may have to do with cause-determined importance. Beginners in 
a domain have less knowledge about what causes what than experts do, so it is hard to give 
special attention to any particular properties, classes, and relations when matching. As 
expert-level performance is reached, more is known about which properties, classes, and 
relations often are related by cause and effect, making it possible let those things weigh 
heavily in matching. Evidently, relations are more often involved in cause and effect than 
properties and classes, explaining the experts' dependence on relations, 

Cause can Bias Matching toward Desired Use 

Introspection tells us that the way things are matched depends on purpose as well as 
experience. The same precedent may match some exercise in more than one way 
depending on what is to be shown or explained, ft is easy to make the existing matcher 
behave this way. 

As it stands, the mechanism that marks relations as important does so whenever they 
appear in a causal chain. A bias-introducing mechanism could mark relations only when 
they appear in a causal chain that leads to some specified relation. With this, it is possible 
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to instruct an example whereby matches with Macbeth go different ways depending on 
("**• whether the interest is in why Macbeth is evil or in why Macduff is loyai. 

REASONING AND CREATING RULES USING ANALOGY 

How is it possible to know if some relation holds in an exercise, given that the exercise is 
analogous to another, well-understood precedent? The answer is that the constraint 
relations in the precedent suggest the right relations to check and the right questions to ask. 
Here we consider only constraint involving causal connections. The key assumption is that 
the causal structure of a precedent is likely to say something about the possible causal 
structure in an exercise to be analyzed. 

Causal Relations Enable Common-sense Reasoning 

Consider the Macbeth precedent, given earlier, together with the following exercise: 

In EXERCISE-MA-1 there is a man and a woman. The man married the 
woman. The man is weak and the woman is greedy. Show that the man in 
EXERCISE-MA-1 may be evil. 

r^-. In the description of Macbeth, Macbeth is said to be weak and his wife, Lady 

Macbeth, greedy. The matching program uses these facts, together with sex classes, to 
claim correspondence between Macbeth and the man in the exercise and between Lady 
Macbeth and the woman. The matcher finds no people in the exercise corresponding to 
Duncan or to Macduff. 

While the man in the exercise is not known to be evil already, Macbeth is. Moreover, 
Macbeth is said to be evil for reasons that hold for the man: both are weak and both are 
married to someone who is greedy. Thus insofar as Macbeth is a precedent for the exercise, 
it seems reasonable for the common reasons to lead to a common effect: the man may be 
evil. 

In this simple illustration, there is only one precedent involved and there is only one 
level of CAUSE relations in that precedent. Naturally the implemented system handles 
more general- situations. To be more precise, the following steps are taken when the user 
asks about some relation in an exercise given a precedent: 

o First, the relation in question may actually be in the exercise. If so, no further action 
is needed. 
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o Second, the relation in question may be caused by other relations in the precedent. If 
so, try to establish the other relations in the exercise. 

o Third, the relation in question may be both absent from the exercise and causeless in 
the precedent. If so, seek another precedent-establishing precedent to work with. 

Thus the causal structure of the precedents serve as a template, guiding the student to the 
possible antecedents of the relation in question. 

Examples further illustrate how these rules work. In figure 2, assume that there is 
enough background information, in the form of properties, classes, and other relations not 
shown, to establish that P-A-l (for precedent agent number 1) matches best with E-A-l (for 
evidence agent number 1), P-O-l (for precedent object number I) with E-O-l, and so on. 
Given this, Rl is justified between E-A-l and E-O-l as follows: first, Rl in the precedent is 
caused by R2 between P-A-2 and P-O-2; and second, R2 is in place between E-A-2 and 
E-O-2 in the exercise. 



~ . « Rl 7 

P-A-l . ... » ■ P-0-1 E-A-l ~ - _ -^- E-O-l 



P-A-2 > P-0-2 E-A-2 — £L-^ E-0-2 



PRECEDENT EXERCISE 



Figure 2: An example illustrating reasoning by analogy. Relation Rl may be justified in 
the exercise by reason of the causal structure of the precedent and the known relation, R2, 
in the exercise. Unlabeled relations are CAUSE. 



The example of figure 3 is more difficult only because the causal chain must be 
chased a little further, R2 in the exercise is at issue. By going back two steps in the 
precedent's causal chain from R2, R4 is encountered, which is in place in the exercise. 
Other relations that come after R2 and before R4 in the chain are ignored. 
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Figure 3: An example illustrating reasoning by analogy with a two-step causal chain. 
Relation R2 may be justified in the exercise because the causal chain of the precedent leads 
to relation R4, which is in a corresponding place in both the precedent and the exercise. 
Unlabeled relations are CAUSE. 



Finally, the example of figure 4 goes a little further still in that two precedents are 
needed. Moving back through the causes in the first precedent, P, relation R3 is 
encountered, but it is not in place in the exercise, nor is it caused by another relation. To 
establish R3, it is necessary to use another precedent, Q, with another causal chain that can 
be exploited. Here the causal chain of the other precedent leads from R3 to R5, which is in 
place, thereby justifying both R3 and the original relation at issue, Rl. 
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Figure 4: An example illustrating reasoning by analogy with two precedents needed. 
Working on relation R2 in the exercise requires both precident P and precedent Q. 
Unlabeled relations are CAUSE. 
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Reasoning may be for Confirmation or Prediction 

When working with Macbeth and Exercise- ma- J, the precedent was used to confirm that a 
certain relation held at the time of analysis. The action would be the same if the precedent 
were used to predict that a certain relation would hold at some time in the future. Indeed, 
the implemented programs cannot know the difference since the representation used has 
no provision for denoting past, present, or future. 

There is some implicit sequence information, however, since the the word because is 
always taken to imply that one relation contributes to the existence of another at a later 
moment. In unrestricted English, because is used ambiguously. In "Macbeth killed 
Duncan because Macbeth was evil," the meaning is that Macbeth's evil quality was one of 
the things that contributed to the murder; in "Macbeth was evil because Macbeth 
murdered Duncan," the meaning is that Macbeth's murder of Duncan forces the 
conclusion that he must have been evil beforehand. 

Common-sense Reasoning Generates Rule-like Principles 

One way to explain how the analogy-oriented reasoning process works is to note that the 
precedent and the exercise determine an AND tree. The root is the relation to be shown in 
the exercise; the tips are relations that hold in the exercise; and the structure in between is 
/""N supplied by the precedent. 

In describing a precedent and constructing an exercise, the teacher causes attention to 
be drawn to a particular fragment of the causal structure exhibited in the precedent. One 
reason to do this is that the fragment involved may be worthy of special notice. Indeed, it 
may be that for some broad classes of actors and objects, the relations at the AND tree tips 
lead to the relation at the root often, not just in the precedent and the exercise. 

Suppose that a new situation is formed from the relations at the tips and at the root of 
the AND tree. Further suppose that the parts involved are created by making instances of 
the parts in the exercise. In the simple example using Macbeth and Exercise- ma- 1, the 
situation synthesized from the precedent and the exercise is illustrated in figure 5. Note 
that the synthesis procedure ties all the tips to the root directly with CAUSE relations. 

o Situations synthesized from precedents and exercises constitute constraint-describing 
summaries that may be worth remembering as plausibility-indicating principles. 

Displayed in another notation, these principles are plainly like the if-then rules that are so 
popular in Knowledge Engineering; 
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Figure 5: An exercise causes part of the causal structure of the precedent to be extracted, 
forming a rule. The rule is in the same representation used for the precedent and the 
exercise. AKO = A-KIND-OF. HQ = HAS-QUAL1TY. 
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Rule 
if 

then 
case 



RULE-1 

[ MAN-4 HAS-QUALITY WEAK ] 

[ MAN-4 MARRY WOMAN-2 ] 

[ WOMAN-2 HAS-QUALITY GREEDY ] 

[ MAN-4 HAS-QUALITY EVIL ] 

MA 



Since these plausibility-indicating rules are represented internally in the same way 
precedents are, they can be used by the same matching, reasoning, and learning machinery 
that works for ordinary precedents. Thus we will see examples in which old rules lead to 
new ones. 

Figure 6 shows how the synthesis procedure works when there is more depth to the 
AND tree. 

Why Have Rules? 

It is good to have rules for several reasons. First, the cause-effect knowledge in a rule is 
quite explicit, lacking the irrelevant clutter and intermediate reasoning steps of the 
precedents from which rules are derived. Explicit capture of the essentials is one of the 
/—•"■> prime desiderata of good representation. 

Second, it is easier to match to rules than to match to their precedents. Rules have 
fewer parts and fewer properties, classes, and other relations. Matching a new situation 
against a rule is faster and less likely to be diverted from the most useful matching result. 

Third, rules are the stuff of Knowledge Engineering, a part of Artificial Intelligence 
with established techniques for dealing with questions about why a certain conclusion was 
sought, about what facts were involved in supporting it, and about what knowledge was 
involved. 

And finally, fourth, rules are easy to index and retrieve, as we shall see. 

Why Learn Rules? 

It is also good to learn rules. Again there are a number of reasons. 

First, of course, rule learning is interesting for its own sake. What is it about the way 
the world is put together that enables us to capture, summarize, and exploit past 
experience? What are some particular processes for doing these things? Are there others? 
What about the way people do it? What about Medicine, Political Science, and Law? 

Second, there is too much to do. We need systems that can learn rules from 
precedents because the traditional process of extracting Riles from experts is too slow and 
/**-% too expensive. 
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Figure 6: The rule synthesis procedure works because the precedent and the exercise 
determine an AND tree, from which the rule is made. The tips go into the //part of the 
rule and the root into the then part. 
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Third, getting rules from experts rriay be unreliable because the existing experts may 
/""■s have difficulty verbalizing the rule*, they use, even though they may be able to teach the 

subject matter by citing the useful precedents. 

And fourth, there may be no experts because a discipline is too new or too 
complicated. If successful research is done on the difficult problem of automatic precedent 
selection, then analogy-oriented learning systems could operate even when there are no 
human experts to help. 

Why Have Precedents? 

i After learning a rule, it is good to keep its precedents because there may be a need to 
reason on many levels of detail. Existing expert systems have only knowledge distilled 
from the heads of those that contribute to them. The systems themselves have no way of 
asking about the origins of their own knowledge, a defect that can be fatal when a rule is 
misapplied. 

In contrast, when the procedures described here derive a rule, the precedents used are 
noted. This means that the facts behind the rules can be examined when a rule seems to 
lead to a doubtful conclusion. Consider, for example, the following exercise, again to be 
used with Macbeth: 

O- In EXERCISE-MA-2 there is a noble a lady a prince and a king. The noble 

married the lady. The noble is evil and the lady is greedy and the prince is 
loyal. Show that the prince in EXERCISE-MA-2 may kill the noble. 

Together with this exercise, Macbeth dictates the construction of the following rule: 
Rule 



if 



RULE-2 

[ LADY-6 HAS-QUALITY GREEDY ] 

[ NOBLE-8 MARRY LADY-6 ] 

[ NOBLE-8 HAS-QUALITY EVIL ] 

[ PRINCE-4 HAS-QUALITY LOYAL ] 



then 
case 



[ PRINCE-4 KILL NOBLE-8 ] 
MA 

Now consider this exercise, which closely resembles the one just used to create a new rule: 

In EXERCISE-MA-3 there is a noble a lady and a prince. The noble married 
the lady. The noble is evil and the lady is greedy and the prince is loyal. 

The difference between this exercise and the previous one is that there is no king. 
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Nevertheless," analyzing the problem in the light of the rule just created, one finds that the 
match is good and that the analogy procedure is satisfied: it seems that the prince kills the 
noble. Here is the actual trace of the computation, with some cosmetic deletions: 

Matching EXERCISE-MA-3 against RULE-2 

41. values match with 48. and 75. possible. 
Normalized score is 85. % 

I note that [ LADY-2 HAS-QUALITY GREEDY ] for use with RULE-2 
I note that [ NOBLE-2 MARRY LADY-2 ] for use with RULE-2 
I note that [ NOBLE-2 HAS-QUALITY EVIL ] for use with RULE-2 
I note that [ PRINCE-2 HAS-QUALITY LOYAL ] for use with RULE-2 
The evidence from RULE-2 indicates [ PRINCE-2 KILL NOBLE-2 ] 

There is a flaw, however. The exercise has no king for the evil noble to murder. Analyzing 
the problem using Macbeth, rather than the rule, has the following result: 

Matching MA against EXERCISE-MA-3 

42. values match with 184. and 52. possible. 
Normalized score is 80. % 

Match is decisive -- 10. better than next best. 

I note that [ PRINCE-2 HAS-QUALITY LOYAL ] for use with MA . 

Beware! Use of match required creating KING-7 for DUNCAN 

I note that [ NOBLE-2 HAS-QUALITY EVIL ] for use with MA 
I note that [ NOBLE-2 MARRY LADY-2 ] for use with MA 
I note that [ LADY-2 HAS-QUALITY GREEDY ] for use with MA 
The evidence from MA indicates [ PRINCE-2 KILL NOBLE-2 ] 

The line beginning with beware is the important one because it warns that some object in 
the exercise, possibly vital, is missing and must be conjectured. In this example, it can be 
argued that a really smart system would know there must be someone for the prince to be 
loyal to. The point, however, is that it is possible to follow up on doubted conclusions. The 
first step is to follow the trail from the doubted conclusion back through the rule involved 
to the governing precedent from which the rule was derived. The second step is to use the 
precedent for analysis rather than the rule. 

The rule used for [ PRINCE-2 KILL NOBLE-2 ] is RULE-2 
The precedent for RULE-2 is MA 
Matching MA against EXERCISE-MA-3 

Beware! Use of match required creating KING-7 for DUNCAN 



Another possibility is that some part of the causal chain in the precedent may be flawed, 
rarely likely, or inapplicable. Having the precedent handy means that these possibilities, in 
principle, could be pursued. 
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The key idea is that the preceden es that support the rules can be examined in a variety 
of ways, on demand, unlike those of current Knowledge Engineering, which lie inside 
the human expert. The intermediate steps leading from causes to effects can be 
examined and questioned. It becomes possible to reason coherently at more than one 
level. The knowledge is more open, with less of a compiled flavor. 



INDEXING AND RETRIEVING RULES 

Systems with general intelligence will have to reason about all sorts of things, raising the 
question of how to cope when there are many domains to think about and when the 
combined number of rules gets large. Somehow things must be organized so that it is not 
necessary to consider the rules governing greed when dealing with, say, an unconscious 
diabetic. 

A natural idea is that the rules must be grouped with context deciding which groups 
should be considered in any given situation. But this idea raises questions. What are the 
natural groups? Is it possible to fix them in advance? Is it possible to discover them while 
acquiring the rules? What determines context? How does context establish that a rule 
group is active? 

/ ** v Class Determines Storage and Access 

Recall again that the precedent involving Macbeth and the exercise involving a man 
resulted in a rule involving a man, inasmuch as the corresponding object in the exercise was 
a man. Thus the classes of the objects involved in rules is under the control of the teacher 
who supplies the exercises. 

It seems reasonable to assume that a rule about a man may be useful in establishing 
something about man, a noble, or anything else that is a kind of man. It is not so 
reasonable to assume that a rule about a noble will be useful in establishing something 
about a man or anything else that a noble is a kind of. Thus we have the following 
principle: 

o Rules whose conclusion involves some particular actor and object classes should be 
stored so that they may be accessed when those same classes are involved in a 
question. 

With a view toward reasoning by backward chaining, one way to store rules is by 

sorting them into buckets keyed by the class of the actor in the conclusion, then by the act, 

and then by the class of the object. In the implementation, each rule ends up in a 

O multilevel association list stored in the frame describing the actor's class. Figure 7 

illustrates. 
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Figure 7: A rule is stored according to the class of the actor involved in the then part of the 
rule. Further indexing is done using the relation and the class of the object 



For retrieving, there is a complementary principle: 

o Questions that involve some particular actor and object classes should cause access to 
rules whose conclusion involves actors and objects of those same classes. 

In the implementation, the classes that the actor in the question is a kind of are 
examined starting with the most general and progressing to the most specific. All the rules 
associated with a given class are tested to see if the act is the same as that in the question 
and if the object class is something that the object in the question is a kind of. If all tests 
are satisfied for any rule, the rule is tried. For all those involving actors of the same class, 
the most recently created is tried first, on the weak ground that increasing knowledge 
makes rule formation more reliable. *' 
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A rule may fail, of course. The indexing and retrieving apparatus simply makes rule 
f~^ application contingent on two hurdles, rather than just one: first the rule must be found; 

and second the //part of the rule must be compatible with the current situation. 

Class Establishes Context 

Part classes determine context since part classes determine what rules can be tried. Rules 
about nobles are for situations involving nobles, and rules about diabetics for situations 
involving diabetics. The same person may be described in one situation as a noble and in 
another as a diabetic, with the sensible context established and the sensible rules tried 
automatically. 

Storage and Access Needs are Suggestive 

Some interesting ideas leap to mind as a consequence of the indexing and retrieving 
mechanisms. It is to be understood that these ideas are particularly speculative in view of 
the small size of the experiments done so far. 

Top-down accessing. The argument for top-down access is that the rules with the most 
general actor classes involved will be the most reliable. An argument for bottom-up access 
is that rules with actors that are most like the actors in the situation in hand will be the most 
f~^ reliable. 

Rules as constraints on hierarchy. Little is known about what classes there 1 should be 
and about when and how new classes should be formed. It can be that thinking about rule 
indexing and retrieving can help us find the determining constraints. For one thing, class 
refinement may reduce the number of times a rule is found but cannot be used. It may be 
easy to push such an overtried rule into a subclass or to create a new subclass for it by 
noting exactly how the rule fails. New subclass creation would be natural as one becomes 
an expert in a domain, learning many new rules of increasing specificity. 

Rules as intermediates. It is hard to get rules out of some experts, raising doubt about 
whether they really use them at all. Some doctors, for example, seem to dislike having their 
knowledge put into rules. These doctors talk of having a feel for a case that seems to 
involve more than those characteristics that would be in causal chains and hence in rules. 

One argument is that people use rules, but have difficulty articulating them. Another 
is that people do not use rules at all, but somehow work with partly remembered, partly 
forgotten cases from school and practice. 

There is still another possibility, however. Boris Katz notes that a rule may just miss 
applying while its precedent applies perfectly [conversation]. He observes that it makes 
heuristic sense to check the precedent when a rule's then part and many of its //parts match 
the'current problem. Katz has suggested the term near match for these situations. Indeed, 
^ it may be that the rules are not used as "rules," but rather as "abstracts." After all, rules 

summarize a way in which a precedent can be used. If an exercise matches most the if-then 
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parts of a rule, then the precedent from which the rule was derived may be a good 
p :ecedent Earlier discussion suggested that it is always possible to go back to a precedent 
if an application of a derived rule gives a suspicious result. Here the suggestion is that 
going back may be the normal way, using the rule-like summary only to do indexing and 
retrieving. 

Establishing classes using relations. In a sense, using classes to establish context just 
pushes the context problem back a bit, to the question of how classes are established. Of 
course classes often are given in a problem statement Otherwise they may be deduced by 
rules from existing relations: sons of nobles are nobles; and people whose pancreases are 
bad are diabetics. Of course current context determines which rules are available for 
establishing classes using relations, thus suggesting the loop illustrated in figure 8. 




Forward-chaining rules use 
relations to establish classes 
and thereby broaden context; 



Backward-chaining rules made 

available by broadened context 

establish relations in response 

to questions. 




Figure 8: Class, context, and relations interact 



Note, incidentally, that the problem solver is influenced by whatever information it 
has about class. It can be biased toward silly conclusions by being told inappropriate or 
wrong class identifications, just as humans are prejudiced by being told a person is a slob, a 
hero, or socially in or out 
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MACBETH, POLITICS, AND DIABETES 

About two dozen rules have been generated. Some are discussed in this section to illustrate 
additional points. Keep in mind that the performance of the system has to be judged in the 
light of the knowledge in the given precedents. A complete trace is available [22]. 

Generating Rules from other Rules •• Macbeth World 

In this experiment, two rules are used to produce another. One is RULE-1, seen before: 
Rule 



if 



then 
case 



RULE-1 

[ MAN-4 HAS-QUALITY WEAK ] 

[ MAN-4 MARRY WOMAN-2 ] 

[ WOMAN-?. HAS-QUALITY GREEDY ] 



[ MAN-4 HAS-QUALITY EVIL ] 
MA 

Another is derived from the following exercise: 

In EXERCISE-MA-4 there is a man. The man is evil. The man wants to be 
king. In exercise-ma-4 there is a king. Show that the man in EXERCISE-MA-4 
may murder the king. 

Which produces this: 
Rule 



RULE-3 



if 



[ MAN-5 WANT [ MAN-5 AKO KING ] ] 
[ MAN-5 HAS-QUALITY EVIL ] 



then 
case 



[ MAN-5 MURDER KING-8 ] 
MA 

Now consider the following exercise: 

In EXERCISE-MA-5 there is a noble and a lady. The lady is greedy and the 
noble is weak. The noble wants to be king. In exercise-ma-5 there is a king. 
Show that the noble in EXERCISE-MA-5 may murder the king. 

To do the analysis, as shown by the following trace, both rules are retrieved using the 
class-oriented scheme. In addition, one question is answered directly by the experimenter; 
Of course, either rule could have been replaced by a direct use of the precedent from which 
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it v as formed. 

I am trying to show [ NOBtE-3 MURDER KING-3 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> 1 

For [ NOBtE-3 MURDER KING-3 ] 

I use indexes in NOBtE-3 NOBtE KING MAN RUtER PERSON 

and I have discovered: RUtE-3 

Matching EXERCISE-MA-5 against RUtE-3 

39. values match with 55. and 52, possible. 

Normalized score is 75. % 

Match is decisive -- 29. better than next best. 

I note that [ NOBtE-3 WANT [ NOBtE-3 AKO KING ] ] for use with RUtE-3 

To use RUtE-3 I need to know if [ NOBtE-3 HAS-QUAtlTY EVIL J 

I am trying to show [ NOBtE-3 HAS-QUAtlTY EVIt ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> 1 

For [ NOBtE-3 HAS-QUAtlTY EVIt ] 

I use indexes in NOBtE-3 NOBtE KING MAN RUtER PERSON 

and I have discovered: RUtE-1 

Matching EXERCISE-MA-5 against RUtE-1 

12. values match with 55. and 45. possible. 

Normalized score is 26. % 

Match is decisive -- 4. better than next best. 

I note that [ NOBtE-3 HAS-QUAtlTY WEAK ] for use with RULE-1 

To use RUtE-1 I need to know if [ NOBtE-3 MARRY tADY-3 ] 

I am trying to show [ NOBtE-3 MARRY tADY-3 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> t 

I note that [ tADY-3 HAS-QUAtlTY GREEDY ] for use with RUtE-1 
The evidence from RUtE-1 indicates [ NOBtE-3 HAS-QUAtlTY EVIt ] 
The evidence from RUtE-3 indicates [ NOBtE-3 MURDER KING-3 ] 
Rule RUtE-4 is derived from RUtE-3 RUtE-1 and looks like this: 
Rule 

RUtE-4 



if 



then 



case 



[ tADY-7 HAS-QUAtlTY GREEDY ] 

[ NOBLE-9 MARRY tADY-7 ] 

[ NOBtE-9 HAS-QUAtlTY WEAK ] 

[ NOBtE-9 WANT [ N0BtE--9 AKO KING ] ] 

[ NOBtE-9 MURDER KING-9 ] 

RUtE-3 RUtE-1 



In the example, one //"part of RULE-3 is replaced by the //parts of RULE-1, and the 
classes are specialized to LADY and NOBLE. Thus the new rule, RULi-4, has a larger if 
part than those of the Riles it is based on. Not enough has been done to speculate on 
whether a trend toward larger and larger //parts will emerge and become a problem. (Note 
that it is easy to construct other examples in which rules collapse together when common 
causes are discovered for things in the //parts.) 
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o The example illustrates that new learning can be built on top of old. The material for 
a new rule can come from a mixture of retrieved rules and specified precedents as the 
situation demands. Several rules and precedents may be needed to do something 
complicated. 



Examples from Politics World 

Consider the following description: 

In WW there are Germany Hitler Poland and England. Germany is an misled 
country. Hitler is a greedy ambitious dictator. Poland owns Poland. England is 
a loyal country. Germany is misled because Germany is weak and because 
Hitler ruled Germany and because Hitler is greedy. Hitler persuades Germany 
to want to own Poland. Hitler influenced Germany because Hitler is greedy 
and because Hitler ruled Germany. Germany attacks Poland with Hitler using 
some tanks because Germany wants to own Poland and because Germany is 
misled. Poland is a victim-country. England is angry. England attacks 
Germany because Germany attacked Poland and because England is loyal. 
Germany is defeated because England attacks Germany. Hitler kills Hitler. 

It may seem familiar, for it was constructed by word substitution and minor modification 
from Macbeth. Consequently all the Macbeth exercises have parallels too, the following for 
example: 

In EXERCISE- WW-1 there are a country and a dictator. The dictator ruled the 
country. The country is weak and the dictator is greedy. Show that the country 
in EXERCISE- WW-1 may be misled. 



The evidence from WW indicates [ COUNTRY-1 HAS-QUALITY MISLED ] 

Rule RULE-15 is derived from WW and looks like this: 

Rule 

RULE-15 



if 

then 
case 



[ COUNTRY-7 HAS-QUALITY WEAK ] 

[ DICTATOR-8 RULE COUNTRY-7 ] 

[ DICTATOR-8 HAS-QUALITY GREEDY ] 

[ COUNTRY-7 HAS-QUALITY MISLED ] 

WW 
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Indexing and Retrieving with Parts - Diabetes World 

In this example, a medical case, parts of things are involved: 

In CI there is John. John is a patient and a diabetic. John's blood is some 
blood. The blood's blood-sugar is high because the blood's blood-insulin is low. 
The blood-insulin is low because John's pancreas is unhealthy. John is a 
diabetic because John's pancreas is unhealthy. John's heart is unhealthy 
because the blood-sugar is high. John takes some medicine-insulin because the 
blood-insulin is low. John needs to take the medicine-insulin because it is bad 
that the blood's blood-insulin is low and because John's taking of the 
medicine-insulin prevents the blood's blooci-insulin being low. 



In C2 there is Tom and some medicine-insulin. TPW is a diabetic. Tom's blood 
is some blood. The blood's bloocf-sugar is high. The blood's bloop>insulin is 
some blood-insulin. In C2 show that Toni's heart is unhealthy. 

In the result, two parts appear, HEART-3 and BLOQD-SUQAR-4. These parts are 
known to be parts pf the same thing by virtue of PART-OF relations. (The means that the 
rule-using apparatus can deal properly with rules in which the parts involved come from 
either the same or different things.) 

I am trying to show [ HEART-2 HAS-QUAtlTY UNHEALTHY ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> cl 

Matching CI against CZ 

46. values match with 151. and 53. possible. 

Normalized score is 86. % 

Match is' decisive -- 2. better than next best. 

I note that [ BtOOD-SUGAR-Z HAS-QUAtlTY HIGH ] fop use vwith CJ 

The evidence from CI indicates [ HEART-Z HAS-QUALITY UNHEALTHY J 

Rule RULE-31 is derived from CI' and looks like th,is: 

Rule 

RULE-31 



if 

then 
case 



[ BLOQD-SUGAR-4 HAS-QUALITY HIGH ] 
[ HEART-3 HAS-QUALITY UNHEALTHY ] 
CI 



There are so many parts of John and parts of those parts that it is much, faster to do the 
exercise problem with the discovered rule than with the original case: 
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In C2 verify that Tom's heart is unhealthy. 



I am trying to show [ HEART-2 HAS-QUALITY UNHEALTHY ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> 1 

For [ HEART-2 HAS-QUALITY UNHEALTHY ] 

I use indexes in TOM DIABETIC PATIENT PERSON 

and I have discovered: RULE-31 

Matching C2 against RULE-31 

27. values match with 54. and 54. possible. 

Normalized score is 50. % 

Match is decisive -- 6. better than next best. 

I note that [ BL00D-SUGAR-2 HAS-QUALITY HIGH ] for use with RULE-31 

The evidence from RULE-31 indicates [ HEART-2 HAS-QUALITY UNHEALTHY ] 

Note also that the indexing places the entry under DIABETIC, not HEART. The 
result is that the rule will be found whenever it is desired to show that the heart of a 
diabetic is unhealthy, not whenever it is desired to show that any heart is unhealthy. In 
general, when working with actors that are parts of something, it seems sensible to chase 
the PART-OF relations to the end and store in what is found. Figure 9 illustrates. 
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n 



PERSON 



PATIENT 



DIABETIC r^ [HEART HAS-QUALITY UNHEALTHY] RULE-? 



^y Figure 9: The rule for unhealthy hearts is stored under DIABETIC since the unhealthy 
heart used to construct the rule was part of a diabetic. 
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Reasoning by Covering an Antecedent - Diabetes World 

Consider figure 10. A precedent suggests that a relation leads to a number of consequents. 
A number of relations in the exercise parallel those in the tree of precedent consequents. 
These parallel relations are situated such that the tree would be said to be satisfied if it were 
an AND tree. The CAUSE relations point the wrong way, however, so the tree is not an 
AND tree. 



PRECEDENT EXERCISE 



Ri 
/ \ 

R4 7^ ^ \ 




/ 



^ -^R^H 



I 
I 

t 



I 

1 I 

H 



Figure 10: One relation in the precedent leads to a number of consequences, some of which 
are mirrored in the exercise. In this illustration, R3, R4, and R9 are said to cover Rl. 



Still there is some heuristic evidence that the root relation holds in the exercise, for it 
is capable of explaining all of the known relations according to the precedent Let us say 
that the tree is covered. 

Indeed, even if one of the covering relations is the relation to be shown, it still may 
make sense to assume the root relation, since it seems natural and human-like to seek 
complete, tidy explanations. 
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The need for this came up in a diabetes experiment: 
In C2 show that Tom takes the medicine-insulin. 



I am trying to show [ TOM TAKE MEDICINE-INSULIN-2 ] 
Supply t = true, ? = don't know, 1 = look, or a precedent: 

> cl 

Should I use the last match between C2 and Cl ? 

> y 

Bewarel Use of match required creating PANCREAS-2 for PANCREAS-1 
I note that [ BL00D-SUGAR-2 HAS-QUALITY HIGH ] for use with Cl 
I note that [ TOM AKO DIABETIC ] for use with Cl 
All consequences of [ PANCREAS-2 HAS-QUALITY UNHEALTHY ] 

are confirmed. 
The evidence from Cl indicates [ TOM TAKE MEDICINE-INSULIN-2 ] 

It is concluded that the patient needs to take insulin even though the precedent's causal 
chain leading to taking insulin includes only low insulin and an unhealthy pancreas, neither 
of which are established in the exercise. The unhealthy pancreas can be reasonably 
assumed, however, since it is covered by a combination of existing relations and the 
relation to be shown. The covering relations are that Tom is diabetic, that he has high 
blood sugar, and that he takes insulin. All these covering relations appear in the resulting 
rule: 



Rule 
if 

then 
case 



RULE-32 

[ DIABETIC-2 AKO DIABETIC ] 

[ BL00D-SUGAR-5 HAS-QUALITY HIGH ] 

[ DIABETIC-2 TAKE MEDICINE-INSULIN-3 ] 
Cl 
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o The example illustrates that things in the //part of a new rule are not necessarily 
antecedents to things in the then part. The learning procedure does more than rule 
concatenation. 



OPEN QUESTIONS 

It is plain that this work is only a beginning. The next iteration through thinking and 
implementation and experiment should be more ambitious, dealing with weaknesses like 
the following representative ones: 
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o There is no way to criticize a rule. Davis showed how the typical member of a rule 
group can be used to suggest additions to a newly acquired rule supplied directly by a 
human expert [3]. There may be a way to use something like Davis's ideas with 

automatically generated rules. ;; 

I 

o There is no way to handle degree of certainty of cause. Moreover, there is no way to 
handle subcategories of cause such as those sketched by Rieger [13]. Distinguishing 
between things like enablement causes and main causes could make rule formation 
and rule indexing and retrieving better. 

o There is no way to handle constraints about quantities such as those constraints that 
appear in the work of Forbus [7]. 

o There is no way to summarize an episode in a story so as to make a general precis. 

o There are no satisfying ideas about the role of abstraction in doing matching and 
indexing and retrieving. 

o The representation for time is impoverished. Similarly quantification, negation, 
disjunction, and perspective are missing. 



CONCLUSION: SIMPLE IDEAS HAVE PROMISE 

This paper is about a set of ideas that enable learning and reasoning to take place by 
analogy in domains that satisfy certain restrictions: 

o The situations in the domain can be represented by the relations between the parts 
together with the classes and properties of those parts. 

o The importance of a part of a description is determined by the constraints it 
participates in. 

o Constraints that once determine something will tend to do so again. 

Things that involve spatial, visual, and aural reasoning do not seem to satisfy the 
restrictions. Things that involve Management, Political Science, Economics* Law, atld 
Medicine do seem to satisfy the restrictions, however, and are targets for the learning aiid 
reasoning ideas developed here: 
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o Actor-object representation. 

o Importance-dominated matching. 

o Analogy-based reasoning. 

o Learned if-then rules. 

o Actor-oriented indexing. 

o Deduction by covering an antecedant 

It is now clear that simple exercises can be done by way of analogy with precedents. Rules 
can be created at the same time, and they can be indexed and retrieved using the classes of 
the objects involved. Experience informs, or at least prejudices. 

RELATED WORK 

This work has roots in the ARCH system [19], and the FOX system [20], both identified by 
the typical things involved in the learning. The most direct antecedent, however, is the 
MACBETH system [21], which concentrated on representation and matching issues. 
Others who have worked on matching include Michalski, Hayes-Roth, and Vere. See 
Dietterich and Michalski [4] for an excellent review. For analogy itself, Gentner's work on 
the dimensions of analogy is another important precedent [8]. 

With respect to context, Marcus has addressed questions about natural rule groups in 
the domain of English parsing [12]. With respect to indexing and retrieving, both Shortliffe 
[17] and Davis [3] have used various mechanisms different from the one introduced here. 
With respect to constraint, Davis has also shown that the regular structure of if-then rules 
simplifies the problem of knowledge acquisition [3]. Similarly, Berwick has showed how to 
learn the rules for English parsing required by Marcus's parser, arguing that a highly 
constrained rule structure is a prerequisite for such learning [1]. 

Papers by both Shortliffe [17] and by Duda, Hart, and Nilsson [5] show how to 
superimpose a kind of probability theory on top of basic rule systems to establish the 
likelihood of the conclusions that are reached. 

In addition, debt is due to Schank [16], Wilks [18], and many linguists who have 
wondered how thinking is determined by experience. William A. Martin may have had the 
deepest insight along these lines when he remarked in a lecture, "You can't learn anything 
unless you almost know already." 
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APPENDIX 

This appendix contains the notes referenced in the body of this paper. 
Note A: The Implementation is based on FRL 

The actual implementation was done using a version of FRL, an acronym for a LISP-based 
Frame Representation Language, developed by Bruce Roberts and Ira Goldstein [14, 15]. 
FRL was used because FRL has handy mechanisms for asserting relations and attaching 
supplementary descriptions to them. In FRL terms, an actor-act-object combination is 
expressed as a frame, a slot in the frame, and a value in the slot. A supplementary 
description node for an actor-act-object combination is expressed in the form of a so-called 
comment frame attached to the frame-slot-value combination. 

Note B: A Sample Read by the Katz Translator 

The following illustrates the greater power of Katz's translator relative to the simple one 
used in this work: 

In the beginning of the story Duncan was a king. Macbeth who was a happy 
nobleman married Lady-Macbeth. She desired that he become king. She 
persuaded Macbeth who she loved to murder Duncan because she was greedy 
and ambitious and also because she was cruel. Soon she decided to kill herself 
because she and Macbeth were unhappy. Macbeth's murder of Duncan caused 
Macduff who was a loyal nobleman to kill Macbeth. 

Note C: Matcher Performance on Shakespeare Precis 

One curious sort of robust behavior was observed in the matcher: it gives the same relative 
results even as it continues to be debugged. Similarity scores vary, however, as the data is 
changed and newly discovered bugs are removed. The raw scores, the total number of 
corresponding things, for some Shakespeare comparisons are as follows: 
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Similar relative ordering is observed when the similarity measure is taken to be the 
normalized scores, the number of corresponding things divided by the larger of the number 
of corresponding things observed when matching the two situations involved against 



TA 



themselves. 
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JUlius Caesar 
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100 
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36 


100 
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18 


15 


18 


22 



100 

Normalized scores seem useful because a small precedent that is nearly totally matched will 
tend to have a better normalized score than a large precedent that has many accidental 
correspondences arranged in a piecemeal, fragmented way. In fact, neither score is used in 
this paper. 

Tables showing the same alternatives, but with only the cause-determined important 
relations counted, show similar relative ordering. 

Note D: Several Words Imply CAUSE relations 

Many people have attended to the role of cause, particularly Schank [16] and Wilks [18]. 
To handle cause here, the following conventions were honored, based on the work of 
Givon [9]. 

o Acts and relations can cause or prevent acts and relations. The inverses of CAUSE 
and PREVENT are CAUSED-BY and PREVENTED-BY. 
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People can persuade and dissiade. Persuade indicates influence and cause. A 
CAUSE relation is therefore generated by a demon whenever PERSUADE is used. 
Dissuade similarly indicates prevent. Since persuaders and dissuaders normally 
intend for something to happen, INTEND relations are generated too, again by 
demons. Since the person persuaded or dissuaded retains control of what is 
happening, a demon-placed CONTROL relation so indicates. See part a of figure 11 
for an example showing what happens given this: 



Lady-Macbeth persuades Macbeth to murder Duncan. 



INFLUENCE 




MACBETH 



LADY-MACBETH 



/•"""N 



PERSUADE 




CONTROL 



WRT 



MURDER 



DUNCAN 



B 



CONTROL 



MACBETH 
CAUSE I \WRT 




LADY-MACBETH 



MURDER 



DUNCAN 



Figure 11: The meaning of persuade and force. All relations are placed by demons 
whenever PERSUADE AND FORCE are used. 
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o People can also order and forbid. For the moment ORDER anc FORBID simply 
carry demons that place PERSUADE and DISSUADE relatious and trigger their 
demons in turn. 

o People can force. Force is like persuade, except that the person forcing has control of 
what is happening. See part b of the figure for an example showing what happens 
given this use of a FORCE relation: 

Lady-Macbeth forces Macbeth to murder Duncan. 



These conventions differ slightly from those used before [21] in that only acts and relations 
are allowed to cause or prevent acts and relations. People are not 



r> 
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Note E: It is Easy to add a Qualitative Reasoning Mechanism 

In Expert Systems for practical analysis, the rules have numbers associated with them that 
indicate how reliable they are. Shortliffe called these numbers certainty factors and showed 
how to use them to quantify analysis reliability [17]. 

It is possible to create such certainty factors for learned rules by careful examination 
of the precedents. At one point, a qualitative, possibly human-like mechanism was 
implemented and survived for a time. It requires two kinds of calculations: first, a way to 
combine the probability of all rule antecedents to give an overall probability for E, the 
evidence; second, a way to use the current probability for E to produce an influence on 
current probability for the conclusion, C; and third, a way to get an overall probability for 
C, given that several rules argue for it. 

In descriptions of inference nets [5], extensive use is made of the relation between 
probability and odds: 

P = ^- 



+ 1 



Some calculations are easier in probability space, while others are easier in odds space, just 
as in linear systems theory, some calculations are easier in the time domain and some are 
easier in the frequency domain. 
/— v Assuming independence, theory dictates that the combined probability of antecedent 

events is the product of their individual probabilities: 

P(E) = P(E 7 )P(E 2 )...P(E„) 

Theory also dictates that figure 12 captures the relationship among the informed 
probabilities of the conclusion C and the evidence E, the prior probabilities of C and E, 
and the probabilities of C given that E is certain and that not E is certain. 

Unfortunately, when questioning experts about the various prior and boundary 
probabilities, they do not give consistent numbers like those in part a of the figure. 
Consequently, Duda et al. abandon orthodox theory and use a piecewise-linear relationship 
to link C to E, rather that a strictly linear one. Part b of the figure illustrates. 

Finally, if there are several independent rules pointing toward C, the probability of C, 
computed in odds space, is given by the product involving the odds supplied by each rule: 

0(C given evidence) = lambda^. . . lambda^ 0(C a priori) 

where 

^ 1ambda _0(C from rule i) 

lambda,. - 0{Capriori) 
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Figure 12: The probability of a conclusion given the probability of the evidence for it. The 
probability for evidence certain to be absent is c. The probability for evidence certain is d 
The prior probabilities of the conclusion and the evidence are a and b in both graphs. Part 
a illustrates the way the numbers should be related theoretically. Part b illustrates the sort 
of numbers people give, when asked, and what Duda et al. do with them. 



To transform all this to a qualitative theory, it is necessary to have tables relating the 
various levels of certainty rather than formulas. For example, one can have a table for 
combining qualitative odds like the following: 
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ae * almost excluded 
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e 
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ae 
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ft 


e * excluded 



Alternatively, one can use ordinary multiplication, together with a function from names to 
numbers and .an inverse function from intervals to names. This approach was taken, using 
the following, which gives results equivalent to the table: 
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Probabi 1 ity 


Odds 


Name 


.96 


27 


certain 


.90 


9 


almost certain 


.75 


3 


likely 


.50 


1 


neutral 


.25 


.33 


unlikely 


.10 


.11 


almost excluded 


.04 


.04 


excluded 



This was done for combining qualitative probabilities using multiplication and for relating 
evidence probabilities to conclusion probabilities using a piecewise linear relation. 
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AP PENDIX 2: THE EXPERIMENTS 

ITiis appendix contains a trace of a set of experiments, some of which are described in the 
body of this paper. 

In MA there is Macbeth Lady-macbeth Duncan and Macduff. Macbeth is an 
evil noble. Lady-macbeth is a greedy ambitious woman. Duncan is a 
king. Macduff is a loyal noble. Macbeth is evil because Macbeth is 
weak and because Macbeth married Lady-macbeth and because Lady-macbeth 
is greedy. Lady-macbeth persuades Macbeth to want to be king. 
Lady-macbeth influenced Macbeth because Lady-macbeth is greedy and 
because Macbeth married Lady-macbeth. Macbeth murders Duncan with 
Lady-Macbeth using a knife because Macbeth wants to be king and 
because Macbeth is evil. Lady-macbeth kills Lady-macbeth. Macduff is 
angry. Macduff kills Macbeth because Macbeth murdered Duncan and 
because Macduff is loyal. 

In EXERCISE-MA- 1 there is a man and a woman. The man married the 
woman. The man is weak and the woman is greedy. Show that the man in 
EXERCISE-MA-1 may be evil. 

I am trying to show [ M AN-1 HAS-QUALITY EVIL ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>ma 

Matching MA against EXERCISE-MA-1 



21. values match with 184. and 24. possible. 

Normalized score is 87. % 

Match is decisive - 1.0. better than next best. 

I note that [ WOMAN-1 HAS-QUALITY GREEDY ] for use with MA 

I note that [ MAN-1 MARRY WOMAN-1 ] for use with MA 

I note that [ MAN-1 HAS-QUALITY WEAK ] for use with MA 

The evidence from MA indicates [ MAN-1 HAS-QUALITY EVIL ] 

Rule RULE-1 is derived from MA and looks like this: 

Rule 

RULE-1 
if 

[ MAN-4 HAS-QUALITY WEAK ] 

[ MAN-4 MARRY WOMAN-2 ] 

[ WOMAN-2 HAS-QUALITY GREEDY ] 
then 

[MAN-4 HAS-QUALITY EVIL] 
case 

MA 
Should I index it? 
> y 
Noting that [ MAN HAS-QUALITY EVIL ] in MAN suggests RULE-] for THEN 
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In EXERCISE-MA-2 there is a noble a lady a pn nee and a king. The 
^**n noble married the lady. The noble is evil and Jb: lady is greedy and 

the prince is loyal. Show diat the prince in EXERCISE-MA-2 may kill 
the noble, 

I am trying to show [ PRINCE-1 KILL NOBLE-1 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>ma 

Matching EXERCISE-MA-2 against MA 

50. 
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46. values match with 53. and 184. possible. 

Normalized score is 86. % 

Match is decisive -- 13. better than next best 

I note that [ PRINCE-1 HAS-QUALITY LOYAL ] for use with MA 

1 note that [ NOBLE-1 HAS-QUALITY EVIL ] for use with MA 

I note that [ NOBLE-1 MARRY LADY-1 ] for use with MA 

I note that [ LADY-1 HAS-QUALITY GREEDY ] for use with MA 

The evidence from MA indicates [ PRINCE-1 KILL NOBLE-1 ] 

Rule RULE-2 is derived from MA and looks like this: 

Rule 

RULE-2 
if 

[ LADY-6 HAS-QUALITY GREEDY ] 

[ NOBLE-8 MARRY LADY-6 ] 

[ NOBLE-8 HAS-QUALITY EVIL ] 

[ PRINCE-4 HAS-QUALITY LOYAL ] 
then 

[ PRINCE-4 KILL NOBLE-8 ] 
case 

MA 
Should I index it? 

>y 

Noting that [ PRINCE KILL NOBLE ] in PRINCE suggests RULE-2 for THEN 

In EXERCISE-MA-3 there is a noble a lady and a prince. The noble 
married the lady. The noble is evil and the lady is greedy and the 
prince is loyal. Verify that the prince in EXERCISE-MA-3 may kill the 
noble. 

I am trying to show [ PRINCE-2 KILL NOBLE-2 ] 

Supply t = true,-? = don't know, 1 = look, or a precedent: 

>1 

For f PRINCE-2 KILL NOBLE-2 ] 

1 use indexes in PRINCE-2 PRINCE MAN NOBLE PERSON 

and 1 have discovered: RULE-2 

Matching EXERCISE-MA-3 against RULE-2 



44. values match with 48. and 75. possible. 
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Normalized score is 91 . % 

Win by default -- only one possibility. 

1 note that [ LADY-2 HAS-QU AL1TY GREEDY ] for use with RULE-2 

1 note that [ NOBLE-2 MARRY LADY-2 ] for use with RULE-2 

1 note that [ NOBLE-2 H AS-QUALITY EVIL ] for use with RULE-2 

I note that f PRINCE-2 HAS-QUALITY LOYAL ] for use with RULE-2 

The evidence from RULE-2 indicates [ PRINCE-2 KILL NOBLE-2 ] 

Challenge that the prince in EXERCISE-MA-3 may kill the noble. 

The rule used for [ PRINCE-2 KILL NOBLE-2 ] is RULE-2 
The precedent for RULE-2 is MA 
Matching MA against EXERCISE-MA-3 



42. values match with 184. and 49. possible. 

Normalized score is 85. % 

Match is decisive -- 10. better than next best 

I note that [ PRINCE-2 HAS-QUALITY LOYAL ] for use with MA 

Beware! Use of match required creating KING-7 for DUNCAN 

I note that [ NOBLE-2 HAS-QUALITY EVIL ] for use with MA 

1 note that [ NOBLE-2 MARRY LADY-2 ] for use with MA 

I note that [ LADY-2 HAS-QUALITY GREEDY ] for use with MA 

The evidence from MA indicates [ PRINCE-2 KILL NOBLE-2 ] 

In EXERCISE-MA-4 there is a man. The man is evil. The man wants to 
be king. In exercise-ma-4 there is a king. Show that the man in 
EXERCISE-MA-4 may murder the king. 

I am trying to show [ MAN -2 MURDER KING-2 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>ma 

Matching MA against EXERCISE-MA-4 



43. values match with 184. and 46. possible. 

Normalized score is 93. % 

Match is decisive -- 21. better than next best. 

I note that [ MAN-2 HAS-QUALITY EVIL ] for use with MA 

I note that [ MAN-2 WANT [ MAN-2 AKO KING ] ] for use with MA 

The evidence from MA indicates [ MAN-2 MURDER KING-2 ] 

Rule RULE-3 is derived from MA and looks like this: 

Rule 

RULE-3 
if 

[ MAN-5 WANT [ MAN-5 AKO KING ] ] 

[ MAN-5 HAS-QUALITY EVIL ] 
then 

[ MAN-5 MURDER KING-8 ] 
case 

MA 
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She uld I index it? 

Noting that [ MAN MURDER KING ] in MAN suggests RULE-3 for THEN 

In EXERCISE-MA-5 there is a noble and a lady. The lady is greedy and 
the noble is weak. The noble wants to be king. In exercise-ma-5 
there is a king. Show that the noble in EXERCISE-MA-5 may murder the 
king. 

I am trying to show [ NOBLE-3 MURDER KING-3 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>1 

For [ NOBLE-3 MURDER KING-3 J 

I use indexes in NOBLE-3 NOBLE KING MAN RULER PERSON 

and I have discovered: RULE-3 

Matching EXERCISE-MA-5 against RULE-3 
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39. values match with 55. and 52. possible. 

Normalized score is 75. % 

Match is decisive - 29. better than next best 

I note that [ NOBLE-3 WANT [ NOBLE-3 AKO KING ] ] for use with RULE-3 

To use RULE-3 I need to know if [ NOBLE-3 HAS-QU ALITY EVIL ] 

I am trying to show [ NOBLE-3 HAS-QU ALITY EVIL ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> 1 

For [ NOBLE-3 HAS-QU ALITY EVIL ] 

1 use indexes in NOBLE-3 NOBLE KING MAN RULER PERSON 

and I have discovered: RULE-1 

Matching EXERCISE-MA-5 against RULE-1 



12. values match with 55. and 45. possible. 

Normalized score is 26. % 

Match is decisive - 4. better than next best 

I note that [ NOBLE-3 HAS-QU ALITY WEAK ] for use with RULE-1 

To use RULE-1 1 need to know if [ NOBLE-3 MARRY LADY-3 ] 

1 am trying to show [ NOBLE-3 MARRY LADY-3 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>t 

I note that [ LADY-3 HAS-QUALITY GREEDY ] for use with RULE-1 

The evidence from RULE-1 indicates [ NOBLE-3 HAS-QUALITY EVIL] 

The evidence from RULE-3 indicates [ NOBLE-3 MURDER KING-3 ] 

Rule RULE-4 is derived from RULE-3 RULE-1 and looks like this: 

Rule 

RULE-4 



if 



[ LADY-7 HAS-QUALITY GREEDY ] 

[NOBLE-9 MARRY l.ADY-7] 

[ NOBLE-9 HAS-QUALITY WEAK ] 

[ NOBLE-9 WANT | NOBLE-9 AKO KING ]] 
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then 

[ NOBLE-9 MURDER KING-9 ] 
case 

RULE-3 RULE-1 
Should I index it? 

>y 

Noting that [ NOBLE MURDER KING ] in NOBLE suggests RULE-4 for THEN 

In EXERCISE-MA-6 there is a noble and a princess. The princess is 
greedy. Show that the noble in EXERCISE-MA-6 may want to be kin|. 

I am trying to show [ NOBLE-4 WANT [ NOBLE-4 AKO KING ] ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>ma 

Matching MA against EXERCISE-MA-6 

15. values match with 184. and 18. possible. 

Normalized score is 83. % 

Match is decisive -- 2. better than next best 

Beware! Use of match required creating KING-10 for DUNCAN 

To use MA I need to know if [ NOBLE-4 MARRY PRINCESS-1 ] 

I am trying to show [NOBLE-4 MARRY PRINCESS-1] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>t 

I note that [ PRINCESS-1 H AS-QUALITY GREEDY ) for use with MA 

The evidence from MA indicates [ NOBLE-4 WANT [ NOBLE-4 AKO KING ] j 

Rule RULE-5 is derived from MA and looks like this: 

Rule 

RULE-5 
if 

[ PRINCESS-2 H AS-QUALITY GREEDY ] 

[ NOBLE- 10 MARRY PRINCESS-2 ] 
then, 

[ NOBLE- 10 WANT [ NOBLE-10 AKO KING ] ] 
case 

MA 
Should I index it? 
>y 

Noting that [ NOBLE WANT AKO ] in NOBLE suggests RULE-5 for THEN 

In EXERCISE-MA-7 there is a noble a lady and a king. The lady is 
greedy and the noble is weak. Show that the noble in EXERCISE-MA-7 
may murder the king. 

1 am trying to show [ NOBLE-5 MURDER KING-4 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>1 

For [ NOBLE-5 MURDER KING-4 ] 

1 use indexes in NOBLE-5 NOBLE MAN PERSON 
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and I have discovered: RTJLE-3 RULE-4 
r 4atching EXERCISE-MA-7 against RULF-3 

33. values match with 49. and 52. possible. 

Normalized score is 67. % 

Match is decisive -- 23. better than next best 

To use RULE-3 I need to know if [ NOBLE-5 WANT [ NOBLE-5 AKO KING ] ] 

1 am trying to show [ NOBLE-5 WANT [ NOBLE-5 AKO KING ] ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>1 

For [ NOBLE-5 WANT [ NOBLE-5 AKO KING ] ] 

I use indexes in NOBLE-5 NOBLE KING MAN RULER PERSON 

and I have discovered: RULE-5 

Matching EXERCISE-MA-7 against RULE-5 



14. values match with 55. and 25. possible. 

Normalized score is 56. % 

Match is decisive - 4. better than next best 

I note that [ LADY-4 HAS-QUALITY GREEDY ] for use with RULE-5 

To use RULE-5 I need to know if [ NOBLE-5 MARRY LADY-4 ] 

I am trying to show [ NOBLE-5 MARRY LADY-4 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> t 

The evidence from RULE-5 indicates [ NOBLE-5 WANT [ NOBLE-5 AKO KING ] 

] 

To use RULE-3 I need to know if [ NOBLE-5 HAS-QUALITY EVIL] 
I am trying to show [ NOBLE-5 HAS-QUALITY EVIL ] 
Supply t = true, ? = don't know, 1 = look, or a precedent: 

> 1 

For [ NOBLE-5 HAS-QUALITY EVIL ] 

I use indexes in NOBLE-5 NOBLE KING MAN RULER PERSON 

and I have discovered: RULE-1 

Matching EXERCISE-MA-7 against RULE-1 






17. values match with 60. and 45. possible. 

Normalized score is 37. % 

Match is decisive -- 9. better than next best 

I note that [ NOBLE-5 HAS-QUALITY WEAK ] for use with RULE-1 

J note that [ NOBLE-5 MARRY LADY-4 j for use with RULE-1 

I note that [ LADY-4 HAS-QUALITY GREEDY ] for use with RULE-1 

The evidence from RULE-1 indicates [ NOBLE-5 HAS-QUALITY EVIL ] 

The evidence from RULE-3 indicates [ NOBLE-5 MURDER K1NG-4] 

Rule RULE-6 is derived from RULE-3 RULE-1 RULE-5 

and looks like this: 

Rule 

RULE-6 
if 

[ LADY-8 HAS-QUALITY GREEDY ] 

( NOBLE- 11 MARRY LADY-8 ] 
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[ NOBLE-ll HAS-QUALITY WEAK ] 
then 

[ NOBLE-ll MURDER KING-11 ] 
case 

RULE-3 RULE-1 RULE-5 
Should I index it? 

>y l 

Noting that [ NOBLE MURDER KING ] in NOBLE suggests RULE-6 for THEN 

In EXERCISE-MA-8 there is a noble a lady a prince and a king. The 
noble is evil. The lady is greedy. The noble married the lady. Show 
that the noble in EXERCISE-MA-8 may be dead. 

In EXERCISE-MA-9 there is a man a noble and a king. The man is loyal. 
The man loves the king. The noble murders the king. Show that the 
man in EXERCISE-MA-9 may kill the noble. 

I am trying to show [ NOBLE-6 HAS-QUALITY DEAD ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>ma 

Matching EXERCISE-MA-8 against MA 

50. 



29. values match with 36. and 184. possible. 

Normalized score is 80. % 

Match is decisive - 3. better than next best 

To use MA I need to know if [ PRINCE-3 HAS-QUALITY LOYAL ] 

I am trying to show [ PRINCE-3 HAS-QUALITY LOYAL ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> t 

I note that [ NOBLE-6 HAS-QUALITY EVIL ] for use with MA 

I note that [ NOBLE-6 MARRY LADY-5 ] for use with MA 

I note that [ LADY-5 HAS-QUALITY GREEDY ] for use with MA 

The evidence from MA indicates [ NOBLE-6 HAS-QUALITY DEAD ] 

Rule RULE-7 is derived from MA and looks like this: 

Rule 

RULE-7 
if 

[ LADY-9 HAS-QUALITY GREEDY ] 

[ NOBLE- 12 MARRY LADY-9 ] 

[ NOBLE- 12 HAS-QUALITY EVIL ] 

[ PRINCE-5 HAS-QUALITY LOYAL ] 
then 

[ NOBLE-12 HAS-QUALITY DEAD ] 
case 

MA 
Should I index it? 

>y 

Noting that [ NOBLE HAS-QUALITY DEAD ] in NOBLE suggests RULE-7 for 
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THEN 

(Eval9a) 

I am trying to show [ MAN-3 KILL NOBLE-7 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>ma 

Matching MA against EXERCISE-MA-9 



57. values match with 184. and 65. possible. 

Normalized score is 87. % 

Match is decisive - 17. better than next best 

I note that [ MAN-3 HAS-QUALITY LOYAL ] for use with MA 

I note that [ NOBLE-7 MURDER KING-6 ] for use with MA 

The evidence from MA indicates [ MAN-3 KILL NOBLE-7 ] 

Rule RULE-8 is derived from MA and looks like this: 

Rule 

RULE-8 
if 

[ NOBLE-13 MURDER KING-12 ] 

[ MAN-6 HAS-QUALITY LOYAL ] 
then 

[MAN-6 KILL NOBLE-13] 
case 

MA 
^ Should I index it? 

>y 

Noting that [ MAN KILL NOBLE ] in MAN suggests RULE-8 for THEN 

In WW there are Germany Hitler Poland and England. Germany is an 
misled country. Hider is a greedy ambitious dictator. Poland owns 
Poland. England is a loyal country. Germany is misled because 
Germany is weak and because Hitler ruled Germany and because Hitler is 
greedy. Hitler persuades Germany to want to own Poland. Hitler 
influenced Germany because Hitler is greedy and because Hitler ruled 
Germany. Germany attacks Poland with Hitler using some tanks because 
Germany wants to own Poland and because Germany is misled. Poland is 
a victim-country. England is angry. England attacks Germany because 
Germany attacked Poland and because England is loyal. Germany is 
defeated because England attacks Germany. Hitler kills Hitler. 

In EXERCISE- WW-1 there are a country and a dictator. The dictator 
ruled the country. The country is weak and the dictator is greedy. 
Show that the country in EXERCISE- WW-1 may be misled. 

I am trying to show [ COUNTRY-1 HAS-QUALITY MISLED ] 
Supply t = true, ? = don't know, 1 = look, or a precedent: 

> WW 

Matching WW against EXERCISE- WW-1 
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21. values match with 150. and 24. possible. 

Normalized score is 87. % 

Match is decisive -- 10. better than next best. 

I note that [ DICTATOR-1 HAS-QU ALITY GREEDY ] for use with WW 

I note that [ DICTATOR-1 RULE COUNTRY-1 ] for use with WW 

I note that [ COUNTRY-1 HAS-QU ALITY WEAK ] for use with WW 

The evidence from WW indicates [ COUNTRY-1 HAS-QUALITY MISLED ] 

Rule RULE-15 is derived from WW and looks like this: 

Rule 

RULE-15 
if 

[ COUNTRY-7 HAS-QUALITY WEAK ] 

[ DICTATOR-8 RULE COUNTRY-7 ] 

[ DICTATOR-8 HAS-QUALITY GREEDY ] 

then 

[ COUNTRY-7 HAS-QUALITY MISLED ] 

case 

WW 
Should I index it? 
>y 

Noting that f COUNTRY HAS-QUALITY MISLED ] in COUNTRY suggests RULE-15 

for THEN 

In EXERCISE- WW-2 there are an aggressor-country a dictator a country 
and a victim-country. The dictator ruled the aggressor-country. The 
aggressor-country is misled and the dictatorls greedy and the country 
is loyal. Show that the country in EXERCISE- WW-2 may attack the 
aggressor-country. 

I am trying to show [ COUNTRY-2 ATTACK AGGRESSOR-COUNTRY-1 ] 
Supply t = true, ? = don't know, 1 = look, or a precedent: 
> ww 

Matching EXERCISE- WW-2 against WW 
50. 



29. values match with 35. and 150. possible. 

Normalized score is 82. % 

Match is decisive - 10. better than next best 

1 note that [ COUNTRY-2 HAS-QU ALITY LOYAL ] for use with WW 

I note that [ AGGRESSOR-COUNTRY-1 HAS-QUALITY MISLED ] for use with WW 
I note that [ D1CTATOR-2 RULE AGGRESSOR-COUNTRY-1 ] for use with WW 
1 note that [ DICTATOR-2 HAS-QUALITY GREEDY ] for use with WW 
The evidence from WW indicates [ COUNTRY-2 ATTACK AGGRESSOR-COUNTRY-1 

1 

Rule RULE-17 is derived from WW and looks like this: 

Rule 

RULE-17 

if 

[ D1CTATOR-9 HAS-QUALITY GREEDY ] 
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! DICTATOR-9 RULE AGGRESSOR-COUNTRY-8 ] 
f~\ [ AGGRESSOR-COUNTRY-8 HAS-QUALITY MISLED] 

[ COUNTRY-8 HAS-QU ALITY LOYAL ] 
then 

[ COUNTRY-8 ATTACK AGGRESSOR-COUNTRY-8 ] 
case 

WW 
Should I index it? 

>y 

Noting that [ COUNTRY ATTACK AGGRESSOR-COUNTRY ] in COUNTRY suggests 
RULE-17 for THEN 

In EXERCISE- WW-4 there are a country and a victim-country. The 
country is misled. The country wants to own the victim-country. Show 
that the country in EXERCISE- WW-4 may attack the victim-country. 

I am trying to show [ COUNTRY-4 ATTACK VICTIM-COUNTRY-2 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>ww 

Matching WW against EXERCISE-WW-4 



16. values match with 150. and 19. possible. 
Normalized score is 84. % 
Match is decisive - 10. better than next best 
^ I note that [ COUNTRY-4 HAS-QUALITY MISLED ] for use with WW 

I note that [ COUNTRY-4 WANT [ COUNTRY-4 OWN VICTIM-COUNTRY-2 ] ] 
for use with WW 

The evidence from WW indicates [ COUNTRY-4 ATTACK VICTIM-COUNTRY-2 ] 
Rule RULE-19 is derived from WW and looks like this: 
Rule 

RULE-19 
if 

[ COUNTRY-9 WANT [ COUNTRY-9 OWN VICTIM-COUNTRY-8 ] ] 

[ COUNTRY-9 HAS-QUALITY MISLED ] 
then 

[ COUNTRY-9 ATTACK VICTIM-COUNTRY-8 ] 
case 

WW 
Should I index it? 

>y 

Noting that [ COUNTRY ATTACK VICTIM-COUNTRY ] in COUNTRY suggests 
RULE-19 for THEN 

In EXERCISE- WW-5 there are an aggressor-country a dictator and a 
victim-country. The dictator is greedy and the aggressor-country is 
weak. The aggressor-country wants to own the victim-country. Show 
^^ that the aggressor-country in EXERCISE- WW- 5 may attack the 

victim-country. 
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I am trying to show [ AGGRESSOR-COUN1 R 7-3 ATTACK VICTIM-COUNTRY-3 ] 

Supply t = true, ? = don't know, 1 = look, oi a precedent: 

>1 

For [ AGGRESSOR-COUNTRY-3 ATTACK VICTIM-COUNTRY-3 ] 

I use indexes in AGGRESSOR-COUNTRY-3 AGGRESSOR-COUNTRY COUNTRY THING 

and I have discovered: RULE- 19 

Matching EXERCISE- WW-5 against RULE-19 



12. values match with 28. and 26. possible. 

Normalized score is 46. % 

Match is decisive - 10. better than next best 

I note that [ AGGRESSOR-COUNTRY-3 WANT [ AGGRESSOR-COUNTRY-3 OWN 

VICTIM-COUNTRY-3 ] ] for use with RULE-19 

To use RULE-19 I need to know if [ AGGRESSOR-COUNTRY-3 HAS-QUALITY 

MISLED] 

I am trying to show [ AGGRESSOR-COUNTRY-3 HAS-QUALITY MISLED ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> 1 

For [ AGGRESSOR-COUNTRY-3 HAS-QUALITY MISLED ] 

I use indexes in AGGRESSOR-COUNTRY-3 AGGRESSOR-COUNTRY COUNTRY THING 

and I have discovered: RULE-15 

Matching EXERCISE- WW-5 against RULE-15 



13. values match with 28. and 45. possible. 

Normalized score is 46. % 

Match is decisive - 6. better than next best. 

1 note that [ AGGRESSOR-COUNTRY-3 HAS-QUALITY WEAK ] for use with 

RULE-15 

To use RULE-15 1 need to know if [ DICTATOR-4 RULE AGGRESSOR-COUNTRY-3 

] 

I am trying to show [ DICTATOR-4 RULE AGGRESSOR-COUNTRY-3 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 
> t 

I note that [ DICTATOR-4 HAS-QUALITY GREEDY ] for use with RULE-15 
The evidence from RULE-15 indicates [ AGGRESSOR-COUNTRY-3 HAS-QUALITY 
MISLED] 

The evidence from RULE-19 indicates [ AGGRESSOR-COUNTRY-3 ATTACK 
VICTIM-COUNTRY-3 ] 

Rule RULE-21 is derived from RULE-19 RULE-15 and looks like this: 
Rule 

RULE-21 
if 

[ DICTATOR-10 HAS-QUALITY GREEDY ] 

[ DICTATOR-10 RULE AGGRESSOR-COUNTRY-9 ] 

[ AGGRESSOR-COUNT'RY-9 HAS-OUALITT WEAK ] 

[ AGGRESSOR-COUNTRY-9 WANT [ AGGRESSOR-COUNTRY-9 OWN 
VlCTIM-COUNTRY-9]] 
then 

[ AGGRESSOR-COUNTRY-9 ATIACK VICTIM-COUNTRY-9 ] 
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case 
f~*.. RULE-19 RULE-15 



/"""V 



f~^\ 



c 



hould I index it? 



>y 

Noting that [ AGGRESSOR-COUNTRY ATTACK VICTIM-COUNTRY ] in 
AGGRESSOR-COUNTRY suggests RULE-21 for THEN 

In EXERCISE- WW-6 there are an aggressor-country and a dictator and a 
victim-country. The dictator is greedy. The dictator rules the 
aggressor-country. Show that the aggressor-country in EXERCISE- WW-6 
may want to own the victim-country. 

I am trying to show [ AGGRESSOR-COUNTRY-4 WANT [ AGGRESSOR-COUNTRY-4 

OWN VICTIM-COUNTRY-4 ] ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> WW 

Matching WW against EXERCISE-WW-6 



19. values match with 150. and 23. possible. 
Normalized score is 82. % 
Match is decisive - 6. better than next best 

I note that [ D1CTATOR-5 RULE AGGRESSOR-COUNTRY-4 ] for use with WW 
I note that [ D1CTATOR-5 HAS-QUALITY GREEDY ] for use with WW 
The evidence from WW indicates [ AGGRESSOR-COUNTRY-4 WANT [ 
AGGRESSOR-COUNTRY-4 OWN VICTIM-COUNTRY-4 ] ] 
Rule RULE-23 is derived from WW and looks like this: 
Rule 

RULE-23 
if 

[ DICTATOR-11 HAS-QUALITY GREEDY ] 

[ DICTATOR-11 RULE AGGRESSOR-COUNTRY-10 ] 
then 

[ AGGRESSOR-COUNTRY-10 WANT [ AGGRESSOR-COUNTRY-10 OWN 
VICTIM-COUNTRY-10]] 
case 

WW 
Should I index it? 

>y 

Noting that [ AGGRESSOR-COUNTRY WANT OWN ] in AGGRESSOR-COUNTRY 
suggests RULE-23 for THEN 

In EXERCISE- WW- 7 there are an aggressor-country a dictator and a 
victim-country. 'Die dictator is greedy and the aggressor-country is 
weak. Show that the aggressor-country in EXERCISE- WW-7 may attack the 
victim-country. 

1 am trying to show [ AGGRESSOR-COUNTRY-5 ATTACK VICTIM -COUNTRY-5 ] . 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>1 
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For { /.GGRESSOR-COUNTRY-5 ATTACK VICTIM-COUNTRY-5 ] 

I i> a e 'ndexes in AGGRESSOR-COUNTRY-5 AGGRESSOR-COUNTRY COUNTRY THING 

and I have discovered: RULE-19 RULE-21 
Matching EXERCISE- WW-7 against RULE-19 



7. values match with 23. and 26. possible. 

Normalized score is 30. % 

Match is decisive - 5. better than next best. 

To use RULE-19 I need to know if [ AGGRESSOR-COUNTRY-5 WANT [ 

AGGRESSOR-CQUNTRY-5 OWN VICTIM-COUNTRY-5 ] ] 

I am trying to show [ AGGRESSOR-COUNTRY-5 WANT [ AGGRESSOR-COUNTRY-5 

OWN VICTIM-COUNTRY-5 ] ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> 1 

For [ AGGRESSOR-COUNTRY-5 WANT [ AGGRESSOR-COUNTRY-5 OWN 

VICTIM-COUNTRY-5 ] ] 

I use indexes in AGGRESSOR-COUNTRY-5 AGGRESSOR-COUNTRY COUNTRY THING 

and I have discovered: RULE-23 

Matching EXERCISE- WW-7 against RULE-23 



15. values match with 28. and 25. possible. 

Normalized score is 60. % 

Win by default - only one possibility. 

I note that [ DICTATOR-6 HAS-QUALITY GREEDY ] for use with RULE-23 

To use RULE-23 I need to know if I DICTATOR-6 RULE AGGRESSOR-COUNTRY-5 

] 

I am trying to show [ DICTATOR-6 RULE AGGRESSOR-COUNTRY-5 ] 
Supply t = true, ? = don't know, 1 = look, or a precedent: 
>t 

The evidence from RULE-23 indicates [ AGGRESSOR-COUNTRY-5 WANT [ 
AGGRESSOR-COUNTRY-5 OWN VICTIM-COUNTRY-5 ] ] 
To use RULE-19 1 need to know if [ AGGRESSOR-COUNTRY-5 HAS-QUALITY 
MISLED] 

I am trying to show [ AGGRESSOR-COUNTRY-5 HAS-QUALITY MISLED J 
Supply t = true, ? = don't know, 1 = look, or a precedent: 
> 1 

For [ AGGRESSOR-COUNTRY-5 HAS-QUALITY MISLED ] 

I use indexes in AGGRESSOR-COUNTRY-5 AGGRESSOR-COUNTRY COUNTRY THING 
and I have discovered: RULE- 15 
Matching EXERCISE- WW-7 against RULE-15 



17. values match with 32. and 45. possible. 

Normalized score is 53. % 

Match is decisive - 10. better than next best. 

I note that [ AGGRESSOR-COUNTRY-5 HAS-QUALITY WEAK ] for use with 

RULE-15 

] note tliat [ DICTATOR-6 RULE AGGRESSOR-COUNTRY-5 ] for use with 

RULE-15 

1 note that [ DICTATOR-6 HAS-QU AL1IT GREEDY ] for use with RULE-15 
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The evidence from RULE-15 indicates [ AGGRHSSOR-COUNTRY-5 HAS-QUALITY 
^-k MISLED] 

" ' The evidence from RULE-19 indicates [ ACGRESSOR-COUNTRY-5 ATTACK 

V1CTIM-COUNTRY-5 ] 

Rule RULE-26 is derived from RULE-19 RULE-15 RULE-23 

and looks like this: 

Rule 

RULE-26 

if 

[ DICTATOR-12 HAS-QUALITY GREEDY ] 

[ DICTATOR-12 RULE AGGRESSOR-COUNTRY-11 ] 

[ AGGRESSOR-COUNTRY-11 HAS-QUALITY WEAK ] 
* then 

[ AGGRESSOR-COUNTRY-11 ATTACK VICTIM-COUNTRY-11 ] 
case 

RULE-19 RULE-15 RULE-23 
Should I index it? 

>y 

Noting that [ AGGRESSOR-COUNTRY ATTACK VICTIM-COUNTRY ] in 
AGGRESSOR-COUNTRY suggests RULE-26 for THEN 

In EXERCISE- WW-8 there are an aggressor-country a dictator a country 
and a victim-country. The aggressor-country is misled. The dictator 
is greedy. The dictator ruled the aggressor-country. Show that the 
/"^. aggressor-country in EXERCISE- WW-8 may be defeated. 

I am trying to show [ AGGRESSOR-COUNTRY-6 HAS-QUALITY DEFEATED ] 
Supply t = true, ? = don't know, 1 = look, or a precedent: 
> ww 

Matching EXERCISE-WW-8 against WW 
50. 



f\ 



24. values match with 30. and 150. possible. 
Normalized score is 80. % 
Match is decisive - 1. better than next best 

To use WW I need to know if [ COUNTR Y-5 HAS-QUALITY LOYAL ] 
I am trying to show [ COUNTR Y-5 HAS-QUALITY LOYAL ] 
Supply t = true, ? = don't know, 1 = look, or a precedent: 
>t 

I note that [ AGGRESSOR-COUNTRY-6 HAS-QUALITY MISLED ] for use with WW 
I note that [ DICTATOR-7 RULE AGGRESSOR-COUNTRY-6 ] for use with WW 
I note that [ DICTATOR-7 HAS-QUALITY GREEDY ] for use with WW 
The evidence from WW indicates [ AGGRESSOR-COUNTRY-6 HAS-QUALITY 
DEFEATED] 

Rule RULE-28 is derived from WW and looks like this: 
Rule 

RULE-28 
if 

[ DICTATOR-13 HAS-QUALITY GREEDY ] 
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[ DICTATOR-J 3 RULE AGGRESSOR-C6UNTRY-12 ] 

[ AGGRESSOR-COUNTRY-12 HAS-QUALITY MISLED ] 

[ COUNTRY-10 HAS-QUALITY LOYAL ] 
then 

[ AGGRESSOR-COUNTRY- 12 HAS-QUALITY DEFEATED] 
case 

WW 
Should I index it? 

>y 

Noting that [ AGGRESSOR-COUNTRY HAS-QUALITY DEFEATED] in 
AGGRESSOR-COUNTRY suggests RULE-28 for THEN 

In EXERCISE- WW-9 there are a country an aggressor-country and a 
victim-country. The country is loyal. The aggressor-country attacks 
the victim-country. Show that the country in EXERCISE- WW-9 may attack 
the aggressor-country. 

I am trying to show [ COUNTRY-6 ATTACK AGGRESSOR-COUNTRY-7 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

> WW 

Matching WW against EXERCISE- WW-9 



18. values match with 150. and 23. possible. 
Normalized score is 78. % 
Match is decisive - 5. better than next best 

I note that f COUNTRY-6 HAS-QUALITY LOYAL ] for use with WW 
I note that [ AGGRESSOR-COUNTRY-7 ATTACK VICTIM-COUNTRY-7 ] 
for use with WW 
The evidence from WW indicates [ COUNTRY-6 ATTACK AGGRESSOR-COUNTRY-7 

] 

Rule RULE-30 is derived from WW and looks like this: 

Rule 

RULE-30 > 
if 

[ AGGRESSOR-COUNTRY-13 ATTACK VICTIM-COUNTRY-12 ] 

[ COUNTRY-11 HAS-QUALITY LOYAL ] 
then 

[ COUNTRY-11 ATTACK AGGRESSOR-COUNTRY-13 ] 
case 

WW 
Should I index it? 

>y 

Noting that [ COUNTRY ATTACK AGGRESSOR-COUNTRY ] in COUNTRY suggests 
RULE-30 for THEN 

In CI there is John. John is a patient and a diabetic. John's blood 
is some blood. The blood's blood-sugar is high because the blood's 
blood-insulin is low. The blood-insulin is low because John's 
pancreas is unhealthy. John is a diabetic because John's pancreas is 
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un! .calthy. John's heart is unhealthy because the blood-sugar is high. 
^-^ icuP takes some medicine-insulin because ihe blood-insulin is low. 

John needs to take the medicine-insulin because it is bad that the 
blood's blood-insulin is low and because John's taking of the 
medicine-insulin prevents the blood's blood-insulin being low. 

In C2 there is Tom and some medicine-insulin. Tom is a diabetic. 
Tom's blood is some blood. The blood's blood-sugar is high. The 
blood's blood-insulin is some blood-insulin. In C2 show that Tom's 
heart is unhealthy. 

I am trying to show [ HEART-2 HAS-QU ALITY UNHEALTHY ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>cl 

Matching CI against C2 

50. 

100. 

150. 

200. 

250. 

46. values match with 151. and 53. possible. 
Normalized score is 86. % 
Match is decisive -- 2. better than next best 
/"> 1 note that [ BLOOD-SUG AR-2 HAS-QU ALITY HIGH ] for use with CI 

The evidence from CI indicates [ HEART-2 HAS-QUALITY UNHEALTHY ] 

Rule RULE-31 is derived from CI and looks like this: 

Rule 

RULE-31 
if 

[ BLOOD-SUGAR-4 HAS-QUALITY HIGH ] 
then 

[ HEART-3 HAS-QUALITY UNHEALTHY ] 
case 

CI 
Should I index it? 

>y 

Noting that [ HEART HAS-QUALITY UNHEALTHY ] in DIABETIC suggests 
RULE-31 for THEN 

In C2 verify that Tom's heart is unhealthy. 

I am trying to show [ HEART-2 HAS-QUALITY UNHEALTHY J 
Supply t = true, ? = don't know, 1 = look, or a precedent: 
>1 

For [ HEART-2 HAS-QUALITY UNHEALTHY ] 
I use indexes in TOM DIABETIC PATIENT PERSON 
'^ and I have discovered: RULE-31 

Matching C2 against RULE-31 
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50. 
100. 



27. values match with 54. and 54. possible. 

Normalized score is 50. % 

Match is decisive -- 6. better than next best 

1 note that [ BLOOD-SUGAR-2 HAS-QUALITY HIGH ] for use with RULE-31 

The evidence from RULE-31 indicates [ HEART-2 HAS-QUALITY UNHEALTHY ] 

In C2 show that Tom takes the medicine- insulin. 

I am trying to show [ TOM TAKE MEDICINE-INSULIN-2 ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>cl 

Should I use the last match between C2 and CI ? 

>y 

Beware! Use of match required creating PANCREAS-2 for PANCREAS-1 

1 note mat [BLOOD-SUGAR-2 HAS-QUALITY HIGH] for use with CI 

I note diat [ TOM AKO DIABETIC ] for use with CI 

All consequences of [ PANCREAS-2 HAS-QUALITY UNHEALTHY ] 

are confirmed. 

The evidence from CI indicates [ TOM TAKE MEDICINE-INSULIN-2 ] 

Rule RULE-32 is derived from CI and looks like this: 

Rule 

RULE-32 
if 

[ DIABETIC-2 AKO DIABETIC ] 

[ BLOOD-SUGAR-5 HAS-QUALITY HIGH ] 
then 

[ DIABETIC-2 TAKE MEDICINE-INSULIN-3 ] 
case 

CI 
Should I index it? 

>y 

Noting that [ DIABETIC TAKE MEDICINE-INSULIN ] in DIABETIC suggests 
RULE-32 for THEN 

In C2 show that it is bad that the blood-insulin is low. 

I am trying to show [ [ BLOOD-INSULIN-2 HAS-QUALITY LOW ] HAS-QUALITY 
BAD] 

Supply t = true,' ? = don't know, 1 = look, or a precedent: 

>cl 

Should I use the last match between C2 and CI ? 

>y 

I note that [ [ HEART-2 HAS-QUALITY UNHEALTHY ] HAS-QUALITY BAD ] 
for use with CI 

The evidence from CI indicates [ [ BLOOD-INSULIN-2 HAS-QUALITY LOW ] 
HAS-QUALITY BAD] 



/**\ 
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Rule RULE-33 is derived from CI and looks like this: 
Rule 

RULE-33 
if 

[ [ HEART-4 HAS-QUAL1TY UNHEALTHY ] HAS-QUALITY BAD ] 
then 

[ [ BLOOD-INSULIN-4 HAS-QUALITY LOW ] HAS-QUALITY BAD ] 
case 

CI 
Should I index it? 
>y 

Noting that [ HAS-QUALITY HAS-QUALITY BAD ] in DIABETIC suggests 
RULE-33 for THEN 

In C2 show that Tom needs to take the medicine-insulin. 

I am trying to show [ TOM NEED [ TOM TAKE MEDICINE-INSULIN-2 ] ] 

Supply t = true, 1 = don't know, 1 = look, or a precedent: 

>cl 

Should I use the last match between C2 and CI ? 

>y 

To use CI I need to know if [ [ TOM TAKE MEDICINE-INSULIN-2 ] PREVENT 
[ BLOOD-INSULIN-2 HAS-QUALITY LOW ] ] 

1 am trying to show [ [ TOM TAKE MEDICINE-INSULIN-2 ] PREVENT [ 
BLOOD-INSULIN-2 HAS-QUALITY LOW ] ] 
Supply t = true, ? = don't know, 1 = look, or a precedent: 
> t 

I note that [ [ BLOOD-INSULIN-2 HAS-QUALITY LOW ] HAS-QUALITY BAD ] 
for use with CI 

The evidence from CI indicates [ TOM NEED [ TOM TAKE 
MEDICINE-INSULIN-2 ] ] 
Rule RULE-34 is derived from CI and looks like this: 
Rule 

RULE-34 
if 

[ [ BLOOD-INSULIN-5 HAS-QUALITY LOW ] HAS-QUALITY BAD ] 

[ [ DIABETIC-4 TAKE MEDIC1NE-INSULIN-4 ] PREVENT [ 
BLOOD-INSULIN-5 HAS-QUALITY LOW ] ] 
then 

[ DIABETIC-4 NEED [ DIABETIC-4 FAKE MED1CINE-1NSULIN-4 ] ] 
case 

CI 
Should I index it? 

>y 

Noting that [ DIABETIC NEED TAKE ] in DIABETIC suggests RULE-34 for 
THEN 

In C3 there arc Dick and some medicine-sugar. Dick is a diabetic. 
Dick's blood is some blood. The blood's blood-sugar is low because 
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the blood's blood-insulin is high. Dick's brain is unconscious 
because the blood-sugar is low. It is bad that Dick's brain is 
unconscious. In C3 Show that Dick needs to take the medicine-sugar. 

I am trying to show [ DICK NEED [ DICK TAKE MEDICINE-SUGAR-1 ] ] 

Supply t = true, ? = don't know, 1 = look, or a precedent: 

>cl 

Matching CI against C3 

50. 

100. 

150. 

200. 

250. 

52. values match with 151. and 102. possible. 
Normalized score is 50. % 

Match is indecisive. Top two matches are equally good. 

To use CI 1 need to know iff [ DICK TAKE MEDICINE-SUGAR-1 ] PREVENT [ 
BLOOD-SUGAR-3 HAS-QUALITY LOW ] ] 

I am trying to show [ [ DICK TAKE MEDICINE-SUGAR-1 ] PREVENT [ 
BLOOD-SUGAR-3 HAS-QUALITY LOW ] ] 
Supply t = true, ? = don't know, 1 = look, or a precedent: 
> t 

I note that [ [ BLOOD-SUGAR-3 HAS-QUALITY LOW ] HAS-QUALITY BAD ] 
for use with CI 

The evidence from CI indicates [ DICK NEED [ DICK TAKE 
MEDICINE-SUGAR-1]] 

Rule RULE-35 is derived from CI and looks like this: 
Rule 

RULE-35 
if 

[ [ BLOOD-SUG AR-6 HAS-QUALITY LOW ] HAS-QUALITY BAD ] 

[ [ DIABETIC-5 TAKE MEDICINE-SUGAR-2 ] PREVENT [ BLOOD-SUGAR-6 
HAS-QUALITY LOW]] 
then 

[ DIABETIC-5 NEED [ DIABETIC-5 TAKE MEDICINE-SUGAR-2 ] ] 
case 

CI 
Should I index it? 

>y 

Noting that [ DIABETIC NEED TAKE ] in DIABETIC suggests RULE-35 for 

THEN 

In C4 there is Jack. Jack is a patient. Jack's blood is some blood. 
The blood's blood-salt is low. Jack's taking of some medicine-salt 
prevents the blood-salt to be low because the medicine-salt is some 
medicine and because the blood-salt is a blood-part. 

In CI show that John's taking of the medicine-insulin prevents the 
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biood-insulin to be low. 

/-^ l am trying to show [ [ JOHN TAKE MEEICINE-INSULIN-1 1 PREVENT r 

BLOOD-INSUUN-1 HAS-QUAUTY LOW ] ] l 

Supply t = true, ? = don't know, 1 = look, or a precedent: 
>c4 

Matching CI against C4 

50. 

100. 

30. values match with 152. and 54. possible. 

Normalized score is 55. % 

Match is decisive -- 2. better than next best 

I note that [ BLOOD-INSUUN-1 AKO BLOOD-PART ] for use with C4 

I note that [ MEDICINE-1NSULIN-1 AKO MEDICINE ] for use with C4 

The evidence from C4 indicates [ [ JOHN TAKE MEDICINE-INSULIN-1 1 

PREVENT [ BLOOD-INSULIN-1 HAS-QUALITY LOW ] ] 

Rule RULE-36 is derived from C4 and looks like this- 

Rule 

RULE-36 
if 

r MEDICINE-INSULIN-5 AKO MEDICINE J 
[ BLOOD-INSULIN-6 AKO BLOOD-PART 1 
then 

^ I [PATIENT-l TAKE MEDICINE-INSULIN-5] PREVENT! 

BLOOD-INSULIN-6 HAS-QUALITY LOW]] 
case 

C4 

Should I index it? 

>y 

for THEN ' ^ ^^ " AS ' QmUTY 1 fa PATIENT s «^ts RULE-36 
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